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ABSTRACT 


All integral transforms can be viewed as projections onto collections of func- 
tions in a Hilbert space. The properties of an integral transform are completely 
determined by the collection of functions onto which it projects. The wavelet trans- 
form projects onto a set of functions which satisfy a simple linear relationship between 
different levels of dilation. The properties of the wavelet transform are determined 
by the coefficients of this linear relationship. This thesis examines the connections 


between the wavelet transform properties and the linear relationship coefficients. 
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I. INTRODUCTION 


A great deal has been written about wavelet analysis in the last several years. 
Much of this work however is presented in the language of signal processing. This 
is to be expected since wavelet analysis has been primarily developed in the signal 
processing field. This paper presents the discrete wavelet transform in a projective 
framework. The discrete wavelet transform, like most integral transforms, can be 
viewed as projection onto a new basis determined by a given collection of functions. In 
light of this the properties of the transform are primarily determined by the properties 
of the basis functions. The development of a transform is then a question of finding 
a basis which will produce the properties we desire. 

What properties do we desire in the wavelet transform? We would like the 
transform to incorporate the spectral decomposition, or frequency localization, of the 
Fourier ‘Transform. In addition, we would like to have time-localization of the input 
function. This allows us to determine when in time a given component of the input 
function occurs. Frequency localization in the Fourier Transform is accomplished by 
projecting onto sines and cosines which have non-compact, in fact infinite, support. 
This precludes the Fourier Transform from having time localization capability. Time 
localization can be achieved by using the short time Fourier Transform (STFT), 
which analyzes the input function in small time windows. This time localization is 
fixed in scale, depending on the time window used. Another desired property of the 
wavelet transform is arbitrary approximation power. This is useful if we wish to 
use the transform in a data compression scheme, that is, setting to zero transform 
coefficients below a certain threshold level and storing the input function in terms 
of this reduced coefficient set. Finally, and perhaps most importantly, we desire the 
basis onto which we project to be orthonormal. This will allow easy inversion of 
the transform. If the basis is orthonormal, inversion is accomplished by weighted 


superposition of the basis functions using the transform coefficients as weights. This 








is the case with the Fourier Transform which uses the orthonormal sine and cosine 
basis. ‘This is contrasted with the Laplace ‘Transform which uses an exponential basis 
which is not orthogonal over the real line. This is why the Laplace Transform must 
be inverted by a contour integral in the complex plane. 

The question of developing a transform with these properties is reduced to that 
of finding a basis for L”, the space of square integrable functions on the real line, which 
possesses the desired properties, namely, time and frequency localization, arbitrary 
approximation power, and orthogonality. If we restrict our attention to compactly 
supported functions, we can achieve a measure of time localization, however only at 
a fixed level dependent on the support of the basis function. This severely limits the 
frequency information available as well, since we can only clearly discern the frequency 
which corresponds to the basis functions. Compactly supported functions are easier 
to compute with, hence their use in finite element methods, and we would like to 
use them here. We need to find a way to use compactly supported basis functions 
without limiting the time or frequency information available to us. The solution is to 
use dilations of a compactly supported function. A dilation of f (x) is f (ax) for some 
a, normally a > 0. Notice that as we dilate a function f the support of f changes 
and also the frequency of f changes. This allows us to cover much wider time and 
frequency scales than using basis functions of fixed compact support. To give us 
the maximum amount of flexibility we will use a basis composed of translations and 
dilations of a fixed function @. 


Consider the dilation equation, or two scale recursion relation 


@(x£) = S cad (27 — k) for some {cx}. (1.1) 


The solution is completely determined by the dilation equation coefficients {c,}. Also 
notice this dilation equation with coefficients {c) = 1, c; = 1} is satisfied by the Haar 


function: 











1 for z € [0,1] 


0 for x ¢ [0,1]. 


0 
h(x) h(2x) h{2x-1) 
Figure 1. Dilation of Haar Function 


The Haar Transform which uses as a basis functions derived from h(x) is in 
fact an early example of a wavelet transform and predates the current interest in 
wavelet analysis by several decades. 

In this paper we show that solutions to I.1 exist. which have arbitrary approx- 
imation power and are orthogonal to their integer translates. We further show how 
these solutions can be used to construct a basis for L?, and how the discrete transform 


which represents projection onto this basis can be computed in order N operations. 














Il. EXISTENCE, UNIQUENESS, 
APPROXIMATION, AND ORTHOGONALITY 


A. EXISTENCE AND UNIQUENESS 

Before we investigate the relationship between the coefficients of the dilation 
equation and the properties of the solutions, we need to determine under what con- 
ditions a solution in fact exists. To begin our search for solutions to the dilation 


equation let us consider the iteration 


bn+i = > Ckbn (2a — k). (11.1) 


k 
Solutions to the dilation equation are fixed points of the dynamical system defined 
by this iteration. The following theorem, which we present without proof, gives 
conditions under which square summable solutions to the dilation equation exist and 


is found in [Ref. 1]. 
THEOREM II.1. Jf the {c,} satisfy the following conditions 


1. {c,} is a finite set, 
2: ee Ch = 2. 
3. |r (z) |? + |r (z + 7) |? = 1 for all z € R, where mp (z) = yy Gee 


then the dynamical system in II.1 has a nontrivial square summable fixed point 
with compact support. 


In the same paper, a similar result is presented for distributional solutions to 
I.1 which does not require the third condition. In practice we are looking for a basis 
for the function space L*, so we restrict our attention to square summable solutions. 
Uniqueness of this solution, up to normalization, is guaranteed by the same 
conditions which give us existence. In the square summable case the normalization is 


{| ¢dx =1. Observe that this normalization requirement is consistent with condition 








2 above since 


[e@a = [Nader 


= soe | ow ay where y = 24 —k 
k 
implies : » Ce = J Or d Cn. 

Before proceeding with our discussion of approximation let’s look at some 
solutions to I.1 which are familiar to us. In the introduction we saw for coefficients 
{1,1} the solution to I.1 was the Haar function. Other familiar functions which are 
solutions to the dilation equation, though we may not recognize them as such, are the 
Dirac delta function for {2} and the cardinal B-splines for { (7) } normalized to sum 
to two. The Figure 2 shows the dilation of the “Hat” function which is the solution 
for the dilation equation for {4,1,4}, the binomial coefficients for n = 2, normalized 
to sum to two. 

The Cardinal B-splines illustrate why the third condition in Theorem II.1 is a 
sufficient but not necessary condition for square summability. The Cardinal B-splines 
are clearly square summable, but it is easily seen that {(7)} do not satisfy the third 


condition of Theorem II.1. 


B. SOME TOOLS FOR DILATION EQUATIONS 

Before proceeding with our investigation of the relationship between the di- 
lation equation coefficients {c,} and the corresponding solution ¢(x), we should in- 
troduce a very useful tool in the study of dilation equations. Dilation equations are 
difficult to study because only in special cases do we actually know what the solution 
function is. We are usually limited to knowing only the recurrence relation between 
different scalings of the function. Faced with this lack of information we must turn 


to the Fourier Transform to glean any information we can about the function. Let us 


see what the recursive nature of I.1 can tell us about the solution ¢(z). 











Figure 2. Dilation of “Hat” Function 


We are given 
o(z) =) c.d(22—k) for some {cx}. (II.2) 
k 
Now, consider the Fourier Transform ®(£) of ¢(z) 
b(¢) = | ” b(a)e-*de (11.3) 
substituting II.2 into II.3 we get 


O(£) = a eS" c.6(22 — k)dx 


Or 


6(£) = Ya | b(22 — k)e** dx 
k —CoO 
in each integral of this sum make the change of variables y = 2x — k which yields 


BQ) =F ae [oye Hay (11.4) 
k —oo 














Now, notice the integral in II.4 is ®(&) ,so we have 
1 we 
® (€) = pune (é) ; 
Applying this process repeatedly to ®(£/2), ®(€/4), ...0(€/2") we get 
+ 1 xith € 
(£) = |] 5 che 2) (57) 
j=l k 
Let us now take the limit as n > ~, 
7 1 =itk 
6(é) =|] : S- cxe 2 (0). (II.5) 
k 


If we require by way of normalization that [ ¢dx = 1 then we have ©(0) = { ¢dz = 1 


and II.5 becomes 


® (€) = Ils dove. 
3=1 k 


Notice we could write this infinite product as 


00 
®({) = [Isom (3) 
j=l k 
Now we see the importance of the mo(z) expression in the third condition of Theorem 
II.1, the behavior of this trigonometric polynomial determines the convergence of the 
infinite product representation of the Fourier ‘Transform, and therefore the existence 
of a square summable solution to I.1. A fairly simple, yet powerful result of this 
infinite product representation of the Fourier Transform is the Convolution Theorem 


for Dilation Equations. 


THEOREM II.2. Let ¢ and y be solutions to the dilation equation for coefficients 
{cy} and {d,} respectively. The function ¢* y given by the continuous convolution of 
db with p is the solution to the dilation equation with coefficients {b;}, where {bj} ts 
one half the discrete convolution of {cx} with {d)}. 


Proof. As we have seen the Fourier Transforms of ¢ and y are given by 


ry 1 =itk ils = 
@ (€) = IIs Che 2” and W (€) = [15 doae* 
n=0 k n—0 i 











respectively. The product of these transforms ®W is given by 
sae | ee | sit 
Oy — — Cre 2” — die? , 


We can combine the two product operators by associating the factors where n = m 


to get 
Ov = IT - Yee S- deo. 
n=0 k l 


Observe each factor in this infinite product is a product of two polynomials in em, 
namely, + >>; chem and oy dea". Let p(&) be the product of these polynomials. 


From polynomial multiplication, we see the coefficients of p(£&) are given by 


1 mA 
r= 5 Labs 


that is, the set {b,} is one half the discrete convolution of {c,} with {d,}, and the 


product polynomial p is 
p(f) = ; em 
Substituting this into the expression for ®W gives us 
oO 4 ae 
wee lige. mn 
Observe the right hand side of this equation is the infinite product representation 
of the Fourier Transform of the solution to the dilation equation with coefficients 
{b,}. Thus, ®W is the Fourier Transform of the solution to the dilation equation for 
coefficients {b;}. Now, from the convolution theorem for Fourier Transforms we know 
®W is the transform of ¢ * y, the continuous convolution of ¢ with y. Since Fourier 
Transforms are unique this completes the proof. C 
Armed with this result we see why the Cardinal B-splines are solutions to 


the dilation equation for the binomial coefficients normalized to sum to two. If we 


develop B-splines from a repeated convolution standpoint as is done in [Ref. 4], the 





relationship between B-splines and binomial coefficients becomes transparent in light 
of Theorem II.2. To generate the B-splines we start with the Haar function which we 
can consider the “zeroth” order B-spline (piecewise constant approximation), we get 
the next higher order B-spline (piecewise linear approximation) by convolution with 
the Haar function. By our convolution theorem this says we should take one half the 
discrete convolution of {1,1} with itself. Convolving {1,1} with itself we get {1,2,1} 
the binomial coefficients for n = 2, which we must normalize to sum to two. Similarly, 
to generate the (n+ 1)** degree B-spline we convolve the n degree B-spline with the 
Haar function, so we convolve the coefficients of the n‘* degree B-spline with {1, 1}. 
This gives us the binomial coefficients for n-+1, which again we must normalize to sum 
to two. ‘The appearance of the B-splines is of more than passing interest. B-splines 
and their translates are often used as a basis for approximation. This is very similar 
to the scheme we are investigating. We are pursuing the goal of representing L? in 
its entirety rather than approximating functions in a subspace of L?. Another aspect 
of spline approximation which will be of great importance in the next section is the 
use of sliding window filters as a tool to smooth data. Sliding window filters can be 
viewed as convolution with the Haar function. Thus repeated application of sliding 
window filters is equivalent to repeated convolution with the Haar function, both of 
which lead to smoother data, or smoother approximation if one is constructing a basis 


function, as we shall see in the next section. 


C. APPROXIMATION 


Since we will be using solutions to I.1 as a basis for approximation we would like 
to know how well an arbitrary function can be approximated by ¢ and its translates. 
Our measure of approximation power will be polynomial precision, or what degree 
arbitrary polynomial can be exactly represented by ¢ and its translates. A key step in 
finite element methods is to approximate a function by the translates of a compactly 


supported basis function. To determine the approximation power of solutions to the 
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dilation equation we consider the work done on the finite element method by Strang 
and Fix. In [Ref. 3] they show that the following statements are equivalent: 
1. Any polynomial of degree less than or equal to p—1 can be exactly represented 
by a linear combination of ¢ and its translates. 


2. &(0) #0 and 5 O(£) |e-am= 0 forn € Z,n #0 and a=0,1,...,p. 


The first of these statements is the definition of approximation power that 
we are interested in, the second is related to the Fourier Transform of the function 
o. We will use the second statement to construct a condition on {c,} that will give 
the desired approximation power. First notice that ®(0) 4 0 is taken care of by our 


normalization requirement since 


® (0) = / de" dx = / odz = 1. 
To satisfy the rest of this statement we must look at the infinite product representation 


of & (£) 


6) =T] 2 rac 
n=1 k 


Since this product converges and ®(0) 4 0 we see that the product vanishes for some 
value of € if and only if at least one of its factors vanish for that value of £. Observe 


that the following condition is sufficient to ensure the desired behavior of © (€): 
e z=7 is a root of order p of mp (z). 
In the previous section we saw 
& (¢) =|] mo (=) | (11.6) 
n=l 


Now, for all! € Z, 1 #0, there exists n such that an mod 27 = 7. Therefore, one 


of the factors in II.6 is zero, and ® (271) = 0. Now consider = I (€)], 


zai fm(S)]y($)-($)[Dm(6)) 0 


kin 


1] 





Since ma (z) has a root of order p at 7, the right hand side of II.7 is zero. Similarly 
we can see a [® (€)] = 0 for 7 = 0,1, ..p provided mg (z) has a zero of order p at 7. 
Unfortunately, this elegant sufficient condition on mo (z) is not necessary. 
Observe, if 3 I® (€)] = 0, Zz [mo (7)] need not be zero, since mp (4), which is a factor 
of [Tn Mo (4-) could be zero, in which case, II.7 will be satisfied regardless of the 
value of 3 [1m (7)]. 
The sufficient condition for the approximation power of ¢ can be arrived at in 


several ways. In [Ref. 2] it is presented as a sum condition, that is: 


N 
S—(-D' Fe =0 for k=0,1,...,p—1. (II.8) 


l=0 
We can see this is equivalent to our condition that 7 be a root, of order p, of mp (z), 


by first expressing the sum condition as a matrix equation, 
Kc =0 
where 
Ki5 = (-1)’ #. 


K isap xX N+ 1 matrix with the following structure: 


I -1 1 -1 #1 
QO -1 2 -3 4 
0-1 4 -9 16 
0 -l1 8 -27 64 
Q -1 16 -81 256 


Calculating the null space of this matrix yields a basis for the null space which is 


given by {[v*]} where lvz| is the N + 1 long vector whose non-zero entries begin 


at the k” position and are the binomial coefficients (7) for k = 1,2,...,.N —p. For 
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—_ wo wo e_ & 


Since this is a basis for the null space of K, any {c,} which satisfies the sum condi- 
tion IJ.8 must be a linear combination of the basis vectors. Since the basis vectors 
are shifted copies of one vector, the matrix whose columns are the basis vectors is 
Toeplitz. So, any linear combination of the basis vectors can be represented as the 
product of this Toeplitz matrix T with a vector whose elements are the weights in the 
linear combination. Alternatively, we can consider this multiplication by a Toeplitz 
matrix to be discrete convolution of the vector of weights with the vector of binomial 
coefficients, i.e. polynomial multiplication if we consider the elements of these vectors 
to be coefficients of polynomials. 

50, what does all this do for us? Any {c,} which satisfies II.8 can be considered 
to be the coefficients of a polynomial f (z) which in turn can be expressed as the 
product of two polynomials g (x) and h (x). The coefficients of g (x) are given by the 
binomial coefficients (") where p is the required approximation power. Recall that 
the polynomial with coefficients (7) is g(x) = (£ +1)”. That is, the polynomial with 
coefficients {c,} has a root of order p at z = —1. Now, if we consider the relationship 
between the trigonometric polynomial mp (z) = >, c,e** and the polynomial f (x) = 
>, cee", we see f (e*) is equivalent to mo (z). Further, if f (x) has a root at z = —1, 


then mo (z) has a root at 7. 
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Yet another way to see the sufficiency of our condition for approximation 
power is to observe that each higher order of the root of mp (z) at a is equivalent 
to an additional factor of (c+ 1) in the polynomial whose coefficients are {c,}. In 
turn, each of these factors is equivalent to the discrete convolution of a smaller set 
of coefficients with {1,1}. Now, by our convolution theorem for dilation equations 
each of these discrete convolutions is equivalent to the continuous convolution of a 
function which precedes @ with the function whose dilation equation coefficients are 
{1,1}. Of course the function with dilation equation coefficients {1,1} is the Haar 


function. Recall that the Fourier Transform of the Haar function 1s oF st), which 


decays like z Each factor of (z +1) in the polynomial whose coefficients are {c,} 
introduces a factor which decays like 7 in the Fourier Transform of @. Each factor 
of 7 in the Fourier Transform implies one degree of smoothness, or approximation 


power in the function @. 


D. ORTHOGONALITY 


As stated in the introduction, an orthogonal basis of functions is advanta- 
geous. Orthogonality allows us to reconstruct the input function from its transform 
coefficients by summing the basis functions weighted by the transform coefficients. 
This is the case in the Fourier Transform. By contrast the Laplace Transform uses 
the exponential functions {e?*} as a basis. These functions are not orthogonal over 
the real line and as a result the inverse Laplace Transform involves a contour integral 
in the complex plane. We wish to take advantage of this ease of inversion, so we will 
restrict our attention to orthogonal basis functions. Again, we are limited by not 
having an explicit representation of our basis functions. We must show that there 
exist solutions to I.1 which are orthogonal to their integer translates. Additionally, 
we still require these functions to have the desired approximation power. 

Fortunately, such solutions do exist. In fact, we have already seen one of 


them. The Haar function is the solution to the dilation equation with coefficients 
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{1,1}. Since the Haar function has support width of one unit, any integer translate 
of the Haar function has support which does not intersect the support of the original 
Haar function therefore the Haar function must be orthogonal to any of its integer 
translates. However, the Haar function has poor approximation power, and is not 
an ideal candidate for use as a basis for an integral transform. The other members 
of the Cardinal B-spline family are used for piecewise approximation by higher order 
polynomials and therefore have increasing approximation power and might be good 
candidates for transform basis functions. Unfortunately, the higher order Cardinal 
B-splines are not orthogonal. This is easily seen since each of the B-splines is positive 
valued over their support and the product of two B-splines with intersecting support 
would be positive, thus the inner product of these B-splines would be non-zero. In this 
section we develop both necessary and sufficient conditions for orthogonal solutions 
to the dilation equation. 

Let us first look at the consequences of this orthogonality, and develop a 
necessary condition. Suppose ¢(z) is orthogonal to its integer translates ¢ (x — k) 
for all k € Z, k #0. Orthogonality here is with respect to the inner product on L?, 
that is 


(F(e),9(@))= fF) ade. 
So far we have only considered real dilation equation coefficients. We will continue 
to restrict our attention to real coefficients. However, the following development is 
presented allowing the possibility of complex coefficients to be consistent with the 
above inner product. 
Suppose ¢ (zx) is orthogonal to ¢ (x — k) fork € Z, k £0; additionally suppose 
¢ (2x) is orthogonal to ¢ (2x — 7) for 7 € Z, 7 #0, then 


0= (6(2),6(@—h)) = fd (e) 6 @— Bde. 
Substituting in I.1 for ¢(xz) and ¢ (x — k) we get 


[ (2) 6@—Rdz = [a6 (20-1) ed Re — A) mde. 
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Interchanging the order of integration and finite summation 


[- d(x) b(z—k Fete = em f (2c -l)\¢(Qxr—2k—m)dz. —(IL.9) 


Since ¢ (2x) is orthogonal to ¢ (2x — 7) for 7 € Z, j £0 the integral on the right hand 
side of II.9 must be zero unless | = 2k +m. This simplifies II.9 to 


;. b(r)d¢(a4—k O(a — Bde = > eiti-a af ¢ (2x — 1) ¢ @ (Q2 — Dade. 
So, if @ (x) is to be orthogonal to ¢ (x — k) we require 
Some | (2x — 1) 6 (2x —1)dx = 0. 
—0o 
And since we assume ¢ is not identically zero, the above integral cannot be zero, thus 
S 5 citar =0 fork € Z,k 40. (11.10) 
Additionally, when k = 0 
[$F War = Naw [22 -n6Rz—Var. 
= : = 
Let y = 2x — 1 in the right hand integral and we get 
[ @PWar=5 00 | 6 wowe 
| eee : es 
For this equation to be true we must have 
S- cc) = 2. 


We can combine these to get a necessary condition for orthogonality 








S © cima = 20r forallkeEZ (11.11) 
l 


where 6; is Kronecker’s delta function: 6, = 1 for k = 0, 6, = 0 fork £0. 
It appears that II.10 is yet another condition we are imposing on the dilation 


equation coefficients. However, with a little work we will see that this necessary 
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condition for orthogonality in II.10 is equivalent to the third sufficient condition for 
square summability in Theorem II.1, expressed in terms of the coefficients rather 
than in terms of the polynomial mg (z). Let us start with the third condition from 


Theorem II.1, 


Imo(z)/? + \mo(zt+n) = 1 forallzeR (11.12) 
1 tkz 
where mo(z) = 5 d, Ge. (II.13) 
First, observe 
Mo(z+7) = E > c,e* Ft) = Z > c,e**e*™ ({1.14) 
0 g 2 k 32 k 
Now, if & is even, e*” = 1, and if k is odd, e*" = —1 so 
mo(z +) = = > (1) ce. 
a 


Recall |¢|’ = CC which leads us to 
lm (z)|? + |mo(z + r)|? = Mo(z)mo (z) + Mo (2 +7) My (Z +7). 


Substituting in the expression for 7m (z) from II.13 and the expression for mo (z + 7) 


from II.14 we now get 


Imo(z)° + |rmo(z + 7) |" = 
5 7 ae +-— py —1)* c,e* Mia 1)’ ce#, (11.15) 


Carrying the conjugation down into the trigonometric polynomials and simplifying 


we get 


lmo(z)? + |mo(z + 7)|° = 


= cee Stue™ + 2-1) exe So (-1)' Ge. (11.16) 
k l 


k l 





This sum is a Laurent polynomial in e’*. Keeping in mind that this sum must equal 
one for all z € R, we see that the coefficients of (e’*)” for n 4 0 must be zero since the 
sum is real-valued. We need an expression for the coefficient of (e*)"; with a little 
work we can see this expression is 


(i ; > CiCj—n + : (—1)” S- CjCj—n- 


3 a 





Now notice, if n is odd then 6, is zero automatically. If n is even then we can say 
n = 2m for some m € Z, and 


1 
bn = 5 DGG = 0 


J 


thus 
)_ Coan 0 forme Z, mF<0 
J 


when m= 0, 6, = 1 and 


> C5Cj — 2. 
j 


Combining these conditions we get 
> Gam = 20. forall meZ 
j 


as in condition I1.10. This chain of arguments can be reversed to derive II.12 from 
11.10. So, we have shown the equivalence of the two conditions. If we look for 
orthogonal solutions to the dilation equation, the coefficients necessarily satisfy the 
sufficient condition for square summability. 

This is all well and good, but we still need to find a sufficient condition on 
the dilation equation coefficients to ensure orthogonality. There is a necessary and 
sufficient condition for orthogonality of the solutions of the dilation equation. This 
condition can be found in [Ref. 5], where it is expressed in terms of the location of 


the roots of the trigonometric polynomial mp (z) as defined in Theorem II.1. This 
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condition, while it has the advantage of being both necessary and sufficient, is a little 
cumbersome. We will instead present a slightly stronger condition on the placement 
of roots of mp (z) which is also sufficient for orthogonality. This condition is found in 
[Ref. 5] as well and relies on the necessary and sufficient condition mentioned above. 


We present it here and refer the reader to [{Ref. 5] for proof. 


THEOREM II.3. Let @ be the solution to the dilation equation for coefficients {c;}. 


Suppose m (z) = 4 >, cxe*? satisfies |mpo (z)|’+|mo (z +7)? = 1 for allz ER, and 
mo (0) = 1. If mo (z) has no zeros in |—£,4], then ¢(x) is orthogonal to (x — k) 


forallkEZ, KAO. 


Notice since we required }),c, = 2, we automatically satisfy mg (0) = 1. 
Also, the sufficient condition for approximation power was that mpg (z) have roots of a 
given multiplicity at 7, it is encouraging that this does not conflict with the sufficient 
condition for orthogonality. 

Well known examples of compactly supported, orthogonal solutions to the 
dilation equation with higher approximation power than the Haar function are the 
scaling functions associated with the Daubechies’ Wavelets (Ref. 2]. We will describe 


what a wavelet is in the next chapter. 


19 











20 











IT]. THE DISCRETE ORTHOGONAL 
WAVELET TRANSFORM 


A. DECOMPOSITION OF THE FUNCTION SPACE L? 


In the previous chapter we saw that we could find solutions to the dilation 
equation. We also saw that these functions could be made to have a specified ap- 
proximation power and be orthogonal to their integer translates. In order to develop 
a transform based on these functions we must show that a basis for L’, the space of 
square integrable functions defined on the real numbers, can be formed from solutions 
to the dilation equation. As we have previously seen, the solutions to the dilation 
equation are square integrable provided the dilation equation coefficients meet some 
basic conditions. In this section we will show that we can derive from the solution 
to the dilation equation a basis for L*, and that we need not impose any additional 
conditions on the dilation equation coefficients to accomplish this. 

Let us consider the space, call it Vo, of functions which can be expressed as 
linear combinations of the solution ¢ to the dilation equation and its integer translates. 
Since ¢ is square integrable, Vo is a subspace of L*. Let us also consider the space, 
call it V_1, spanned by ¢(2z — k) where k € Z , this space is composed of functions 
which are linear combinations of /2¢ (2x) and its half integer translates. We have 
scaled the function by 2 so that the norm, in L?, of the prospective basis function 
will be one, this has no impact on the space spanned by the functions. Again, since ¢ 
is square integrable ¢ (2z) is also square integrable and V_, is a subspace of L?. If we 
continue in this manner, taking spaces spanned by $j, = 274/2¢ (2-72 — k), we get an 
infinite sequence of subspaces of L*, namely Vo, V_1, V_o, .... If we also allow positive 
indices for these spaces, which implies negative powers of 2 in 2-4/7¢(2-Jx — k) we 


get a bi-infinite sequence of subspaces of L? 
V; = linear span {¢(2%rc—k)| kEZ}  forj eZ. 


This sequence of subspaces has the following properties. 
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1. The V; form a nested sequence, that is V; C Vj_, 
Suppose f € V; then f is a linear combination of ¢(2-%x —k). Since @ is 
a solution to the dilation equation, ¢(2~%z — k) is a linear combination of 
wo) (2-G-Yg — k), thus Vj C Vj-1 

2. f (x) € V; if and only if f (2x) € Vj-1. 


Suppose f(z) = S\a,¢(24%2 —k), then f (2x) = S\a,¢ (279 (2r) —k) = 
>, a, (2-9 ae —k) thus f (2x) € V;_1. Conversely, suppose f(2y) € Vj_1 
then, f(2y) = > apg (2-8 Vy — k) = Yad (2-4 (2y) — k). Now let x = 2y, 
and we get f (z) = Si a,¢(27%2 —k), thus f (xz) € V, 
3. jen V5 = {0}. 

It is sufficient to show that for all f € C>°, the space of infinitely differentiable, 
compactly supported functions, (P;f,f) —- 0 as 7 — oo. Here P,f is the 
orthogonal projection of f onto V;. As a consequence of II.11 the ¢;, form an 


orthogonal set. Thus, {¢;,} constitutes an orthonormal basis for V;, and the 
orthogonal projector P_; can be expressed as 


Pf = S— (ins F) bie. 
k 


So 
(Pif, f) = (Dnt tnt) = Sodje, FY? 
k k 
and if we assume f has support [—a, al 


2 


bse, f)P =|f 3 2) 2-9°§ (Qe = Bode 
ri f(t) ¢(Q%2 —k $(2-In — b)dx| 


As a consequence of Holder’s inequality 





— 2-9 








. (29x — k) da < ||F| (| b (2 —K) SE Hae) 


[ f (ce) 62-92 — k)dax 


ep) =] 








“soni f° 6 (24a — &) | de 


< | Fil Id (y)|* dy. 


J \y+k|<2~Ja 
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Observe that as 7 — oo the integral on the right hand side goes to zero 
independent of k. Also, each |(;x, f)|” is non-negative. Combining these two 
facts we see 


< (Pf, f) sir f y)|° dy + 0 as j + 00 


ly+k|<2-Ja 


thus, (),¢z V; = {0}. 


These properties, while very helpful, leave us somewhat short of our goal of 
producing a basis for L*. The most obvious shortcoming is that we have not shown 
that any collection of these functions span L?. Before we address the issue of spanning 
L?, let us consider a property of ®, the Fourier Transform of ¢. As we shall see, the 
following limit is of interest to us 

Jim, [ |@ (2%e))? lg (Pao 
for arbitrary g € C§°. In [Ref. 1] we see that subject to the conditions already 
imposed on {c,}, ® is an entire function. Additionally, we have seen ® (0) = 1, and 
\® (z)| < 1 for z € R. We can now use Lebesgue’s bounded convergence theorem 


(Ref. 6] to show 


lim [| (2 Jw) |? lg (w)|? dw = [6 (III.1) 


joo 


Now, let us get back to trying to span L? with some collection of ¢;,. What 


we wish to show is U,-7 V; = L*. Since the V; are nested, it will be sufficient to show 


j€Z, 
that (P_;f, f) > (f, f) as j 3 00 for all f € L? such that f, the Fourier Transform 
of f, isin C&. Let f € L? such that f = g € C5’. As we have seen before the 
orthogonal projector P_; can be expressed as 
Pif =) (f,b-s8) $-i6- 
keZ 
Again we see 


(Pah ty= > \ foul: 


kEZ 
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Recalling that the Fourier Transform we are using has the normalization constant 
in the inverse transform, inner products in the function space are related to inner 
products in the transform space by (¢, ) = 27 (®, W). By standard operational rules 
for Fourier Transforms we can see ®_;,, the Fourier Transform of ¢_;, as defined 


above is given by 
a eV hivg—I/2q (2-Fw) 


All of this now leads us to 
(Fs 0-jx) = 2m (9, B.gx) = 20 |g (w) PARP FROS TI. 

Simplifying where possible and making the change of variable z = 2-4w we get 

(f, b—je) = 20279? / g (27z) ® (z) edz. 
Recall that g has compact support, so for sufficiently large j, g (2)z) is nonzero only 
in |[—7,7] and we can simplify the integral to 

(f, b—jx) = 202797? / g (27z) ® (z) e ** dz. (III.2) 
Now, the right hand side of III.2 is just the k,, Fourier coefficient of the function 
2~4/227g (27z) ®(z). The quantity we are interested in, namely (P_;f, f), is given 
by the sum over k of the squares of the magnitudes of the individual inner products 


given in III.2. Since each of these individual inner products is a Fourier coefficient 


for a specific function, we can use Parseval’s Equality to arrive at 


Poi =>., 


k 


= = / 2-9? 2mg (27z) ® (z)|° dz. 


tT 2 
angie f g (27z) ® (z) e ** dz 


“i 





(III.3) 


Collecting terms and simplifying where possible we get 


1 


Cn a ana | |g (2’z) ® (z) ° dz. 


Fh 
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If we now revert to the original variables, that is, let 27z = w we get 

23x | ee) 
a5 G2 5, Ae 

(Pf, f) = 20 | |g (w) ® (27% w)| dus = 20 f lg (w)|° | (2 Jw) i" dw. 


—2in —o0 


We have seen in III.1 that the right hand integral above converges to 


an | lg (w)|* dw. 


OO 


Combining all we have done we get 


Jim (P5f,f)=2n | |g (w)P dw = 20 (9,9) = (ff). 
Which shows U,<z Vj = L’. 


90 far, we have shown the existence of a sequence of orthonormal sets of 
functions the limit of which is dense in L’. It might appear that we are nearing the 
end of our search for basis functions on which to base our wavelet transform. What 
we have is a good foundation for an approximation scheme, however this scheme 
falls short of satisfying all the conditions we need for our basis functions. Namely, 
projecting onto V; for fixed 7 doesn’t provide any frequency information. If we attempt 
to get frequency information by projecting onto other subspaces V,, for various n # j, 
we no longer have a orthonormal system, since $j, is not orthogonal to @pm for 
j # nas either V; C V, or V, C V;. This leads us to introduce the detail space 
W; associated with V;, which we will call the scaling space. Formally, W; is the 
orthogonal complement of V; in V;_,. This allows us to express V;_, as the direct 


sum of V; and W;. We can express this graphically as 


V5. eh Vi Vo > Vee ee 


~ NN SNS 
W541 W542 Wyss 


Consider the sequence of spaces W,, since each is the orthogonal complement of 


its companion scaling space V; and W;,; is a subspace of V;, it is clear that W; 
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is orthogonal to W;,;. Additionally, we saw earlier that () jez Vj = {0}, this implies 
Ujez Wj = L*. Since the W,’s are all orthogonal, we have a direct sum decomposition 
of L? namely, 
L? = QwWy;j. 
jeZ 

This certainly is helpful, as all we need to do now is find an orthogonal basis for each 
W;. ‘Taking the union of all these basis functions will yield an orthogonal basis for 
i. 

This may seem to be nearly as daunting a task as we initially faced, but we 
can now take advantage of the highly structured nature of the V; spaces and the 
orthogonality of W; to the V;. First, observe that since W; C V;-1, perhaps we can 
use the orthogonal basis for V;_, to construct an orthogonal basis for W;. Let us 
proceed along these lines. Any prospective basis function, y, for Wo, must be an 


element of Wo and since Wo C V_; we must have the following representation for ~ 
p=) dd (22-1). (ILI.4) 
l 


Such functions y are the wavelets which we have alluded to throughout this paper. 
Since we are interested in compactly supported basis functions we assume {d,} to be 
finite. We also require y to be orthogonal to ¢ and all its integer translates, since 
Wo is the orthogonal complement of Vo. To aid us in our investigation we use the 
following representation of the Poisson Summation Formula, a derivation of which is 
found in the appendix, 

Y-(v(z), d(@ —D)e™ = SoU W+2kr)O(W+2knr) fork,leZ.  (IIL5) 

k 


Observe that this formula establishes the equivalence of the following statements: 


1. y(z) is orthogonal to ¢ (x — 1) for 1 € Z. 
2. Diner VY (w + 2kr) ® (w + 2k) = 0 for allw ER. 
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We can see this since if 1 is true then the sum on the left hand side of III.5 is 
clearly zero for all w € R. Conversely, if 2 is true then the left hand side of III.5 is 
a Laurent series in e” which is zero at all values of w, and must be identically zero, 
therefore each of the inner products in the sum must be zero. 

Now, let us apply this to the problem of finding a basis for Wo. Suppose y (z) 
is orthogonal to ¢(z — k) for k € Z, this is equivalent to 


SW (wt 2kn)O(w+2kn)=0 forall wER (III.6) 
k 


We can use III.4 to get an expression for V, the Fourier Transform of —p 


ik ao 1 =! E 
W (€) = d —le"8dr ==S die? O(=). 
= [Nag es —y eas 7 ae te (5) 
As we have seen before, the Fourier Transform, ®, of @ can be expressed 
l —ién ‘a 
P= 5 diene 2 o(£). 
Consider the function 


F (€) =) | (€ + 2kr)?. 


k 


We can write this function in the following way, 


F (£) = 4° (€ + km) © (E+ Qk). 


k 
Now, by HI.5 F is equal to 5°) (¢ (x), ¢@ (x — 1)) = 1 because 9; form an orthonormal 
basis for Vo. So, F (€) =1 forall &é ER 


Define the following trigonometric polynomials 
Di) = = rae# 
2 l 


; » c,e 8". 


Q 
—~. 
Sty 
— 

| 


2 





Substituting into III.6 we get 


O0= SU w+ 2kr) GW + Qk) 
ke 


2 ) kes | dk 
_ SD [= =) ‘ (=) 6C2 2s (—*}. 
" 2 2 2 2 


Observe when k is even D (#247) = D(¥), and when k is odd D (224) = 
D(¢+7). Similarly, when k is even C (etsst) = C(¥), and when & is odd 


C ( 2tear ) = (¢ -- Tw). We can rewrite the sum as 


b (: + — *) 


+ 0( +5) eG ra) fe (ezzeetne 


(III.7) 





2 











; _ (IIL8) 





Factoring out the terms which are independent of k we get 


(2) °@)S |e (S +2) 
+D (5+7)e(S+n) do Ie (S +04 2kn)| (III.9) 


Ihe summations above are simply F (2) and F (2 + T) sO we can write 


SW (wt 2kr) 6 (w+ 2km) = 
D (=) C (=)F (=) +D (= +1] C (= +n)F (= +m). (111.10) 


But F (2) = (¢ + 7) = 1, so we have 
0=S WU w+ 2kr) 6 (+ 2kn) =D =) c (=) + D (= +7) é: (S +7). 
k 
(IIT.11) 
‘Lo simplify our notation we will use w in place of 5+ Since @o, form an orthonormal set, 
C'(w) and C (w + 7) cannot simultaneously be zero; this is a consequence of the third 


condition of Theorem II.1. If III.11 is to be true then when C (w) is zero, C (w+ 7) 
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cannot be zero. Therefore, D(w-+7) must be zero. Similarly, C(w+7) and D(w) 
must have the same zero structure. Since C’' (w) is a trigonometric polynomial, D (w) 


must have the following form 
D(w) =A(w)C(w+7). 


Where A (w) is 27-periodic, and A(w+7) = —A(w). Further, since we desire y 
to be compactly supported, A (w) must be a trigonometric polynomial. Now, III.11 


becomes 


om 
| 


A(w)C(w+r)C(w)+Aw+aC(Ww+r4r)C (w+nr) 
A(w)C (w+7)C (w) —-A(w)C W)C (w+ 7) 


since C'(w) is 27-periodic. Thus we have shown, subject to the above conditions on 
A (w), functions generated by III.4 lie in the orthogonal complement of Vo in V_;. 
What remains to be shown is that these functions ~ are orthogonal to their integer 
translates. 

To show this we will again use the Poisson Summation Formula ITI.5. We see 


that orthogonality of y (x) to y (x — 1) for 1 € Z is equivalent to 
1=S 0 WV (w+ 2kr) V (w+ 2kr). 
k 


Substituting in the expression for the Fourier Transform of » and simplifying in a 


manner similar to that used above we get 


1=S WU (w+ 2kr) VU (w+ 2kt) = Dw) Dw) + Dw+r) Dw. (I112) 


Since D(w) = A(w) C (w +7), we have 
1=A(w)CW+mAWCwtn)t+Awt+r)C@AwtnC(w). 
Reorganizing slightly and recalling that A (w +7) = —A (w) we find 


1=AWw)A(w)C (w+ 7) Cw +7) + A(w) A(W)C (w) C (wv). 
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Since ¢ (x) is orthogonal to ¢ (x — 1), we know C (w +17) C (w+ 7)+C (w) C (w) = 1. 
If we additionally require |A (w)| = 1, then III.12 will be satisfied, and y (x) will be 
orthogonal to y (x — I). 

Let us collect the conditions we have imposed on A(w) and see what type 


function they characterize. 


1. A(w) is a trigonometric polynomial, and 27-periodic. 
2.A(w+7) = —A (w). 
3. |A(w)| = 1. 


Condition 3 implies the graph of A (w) traces out the unit circle or, in light 
of condition 1, A(w) = age*™ for |ag| = 1 and some m. Condition 2 implies m 
must be odd. We have a great deal of freedom in our selection of aj, but since 
we have so far only considered real valued {d,}, we will limit ourselves to ag = +1 
and for this development we will assume ap = 1. We will let m be the highest 
index of the set {c,}', that is, if {c,} has four elements we will set m = 3, because 
{cx} = {co, €1, C2, C3}. 


Having made these choices we see 


i m 
_ tm S| chem tk( (w+m) 
Z = 


Or, after simplifying 


4 m 
ins Ss (- 1 Bo eilktm)w 
~ 5 ) 


k=0 


which we can express as 


‘Condition II.11 implies the highest index of {cx} must be odd. Further any odd m gives rise to 
a translated version of this same y. 
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where d,; = (—1)” ‘G2. That is {d)} = {-—Gy, Garg, -Garay’** » 0) —Gy%}. Recall 
this {d,} is such that y (rz) = 5°, di (2x — 1) and its integer translates y (x — k) form 
an orthonormal set in Wp. 

It is not obvious that this set spans Wo. We can see that it does by employing 
an argument similar to that above. Suppose g(x) € Wo, then g(x) € V_; and 
g(x) LVo. We can express g (x) as 


g(x) =) ud (22-1). 


This, in turn gives us G (£), the Fourier Transform of g (x) 


G (g) = = one Fe (£) 


l 


Define the Laurent series in e~*, I’ (€) by 
r@-4 yon 
2 
Since g(z) Vo, we can obtain the following relationship between C (€) and I (£) 


r=r(JeQ) (Ge) 


Now, by exploiting the zero structure of C (€) we can see I’ (€) must have the following 


form 
P(g) =BE)CE+n), 
where B (€) satisfies the following: 


1. B(E) is a Laurent series in e~*. 
2. B(€) is 2-periodic. 
3. B(é+7) = —B(E). 


Conditions 2 and 3 above imply B(€) consists solely of odd powers of e~%. 


Each of these odd powers in turn corresponds to a translation of the function y. So, 
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any function g (x) € Wo can be represented by a weighted sum of y (x —k). Thus we 
have shown y (x — k) span the space Wp. 

To summarize, so far we have a sequence of spaces W; the direct sum of which 
is L*. We have demonstrated a basis {y (x — k)} for Wo which is constructed from 
functions ¢ (2x — 1) which form a basis for V_;. Now we need to show an orthonormal 
basis for W; is given by {yj, = 2~4/*y (2%2 —k)}. To do this we use III.5. From 


standard Fourier Transform operations we can see 


Wx (€) Q5/2¢-Pkigy (27) 


Oi (E) = We PRED (29¢) | 


| 


It is easily verified using arguments similar to those above that (;~ 18 orthogonal to 
?jx. It is equally easy to verify (jx, jn) = On, Thus for each scaling level 7 we 
have an orthonormal set {y;,}, which lies in W;. All that remains to show is that 
each set spans the respective space W;. This is accomplished in a manner completely 
similar to that used for Wo. Finally, we have an orthonormal basis for L?, namely, 


{Pin = 2-4/?y (2-Fa — k)} for j,k € Z. 


B. ALGORITHM DEVELOPMENT 

Armed with this basis for L? we now set out to implement a discrete transfor- 
mation which, as promised in the introduction, has good time-frequency localization, 
suitable power of approximation, and can be computed quickly. Time localization is 
a result of the compact support of the scaling functions and wavelets, and the fact 
that the support of these functions shrinks as the index of the subspaces V; and 
W; decrease (toward —oo). Frequency localization is accomplished by dividing the 
spectrum of the input function into “octaves” each of which is represented by the 
projection of input function onto some W;. This is not as sharp as the frequency 
localization of the Fourier Transform, but it is still quite good, and can be computed 
rapidly. The entire derivation of the basis functions was driven by the desire to take 


advantage of a recursive relation between basis functions. We do not have a recursive 
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relation between the actual basis functions y,;,, however, we do have a linear relation 
between the basis functions and a set of auxiliary functions P;k, Which we call the 


scaling functions 
g(x) =) do (2z-1). (III.13) 
; 


This would not be of much use without the associated recursive relation between the 
scaling functions at subsequent levels of scaling 
(2) = Y_ cg (22 — k). (111.14) 
k 
We will exploit these relations to achieve a computational efficiency of order N opera- 
tions. In computing a transform we are concerned with projections. Since projection 
operators are linear, we can recast III.15 and II.16 in terms of the projection of an 


arbitrary function f (x) on ;, and ~;x. Specifically, 


(f (x), 6(x)) = S— ce (f (x), ¢ (22 — k)) (III.15) 
and 
(f (x), p(x)) = S~ dy (f (x), (2a — k)). (111.16) 


Put another way, these relationships allow us to compute the projection of f (x) onto 
W; given the projection of f (x) onto V;_1. 

Before we can develop an algorithm, we need to recognize that the theory we 
have developed so far defines a transform which operates on functions in L?, square 
summable functions defined on the real numbers. Further, the transform projects 
the input function onto a bi-infinite sequence of subspaces of L?. In practice we are 
given a sequence of uniformly sampled values of the input function instead of the 
actual function. We will, for the purposes of this development, assume the input 
function f is zero at its boundaries. By doing this we can “pad” the function with 


zeros and apply the transform as if the function were defined over the entire real 
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line. ‘There are methods of treating input functions which are not zero at their 
boundaries, but these methods are beyond the scope of this development. Next we 
must address the question of where in the bi-infinite sequence of subspaces to start 
the transform. The sampled values of f are a piecewise constant approximation to 
the actual input function’. We will define the fine scaling unit to be the “distance” 
(difference in independent variable) between successive samples. A consequence of the 
orthogonality of the scaling functions is that they must have approximation power at 
least one. This is easily seen since |r (z)|" + |mo(z+a)|° = 1 for all z € R, and 
mo (0) = 1, mo (7) = 0. Put another way, the polynomial with coefficients {c,} has a 
root at 7, which tells us the scaling function associated with {c,} has approximation 
power at least one. How do we use this fact? Over the region where f 1s represented 
by a constant, the scaling function and its translates can exactly represent f. Thus 
the projection of f onto the wavelets, y;,, at this scaling level is zero. Also, at any 
finer scaling level the projection of f onto the wavelets must be zero. In light of 
these facts we will start the algorithm at scaling level /, where the scaling function 
2/24 (2'x) has support width of one fine scaling unit. We call this the finest scaling 
level. 

We now outline the algorithm to compute the discrete, orthogonal wavelet 
transform. Figure 3 depicts the arrangement of wavelet and scaling functions. The 
first step in the algorithm is to calculate the projection of the input function onto the 
scaling functions at the finest scaling level. There are many ways to accomplish this, 
one way is presented in the appendix. Once we have these projections, the algorithm 
is simply a matter of using ITI.15 and IIJ.16 to reorganize the data into the projections 
onto V;,; and W,,,. This is accomplished by taking weighted sums of the projections 


onto V;. To calculate projections onto Vi.,;, we use as weights {c,}. To calculate the 


“Other approximations may be used, for instance, if the input function is represented in a B- 
spline basis of order two, we would have a piecewise quadratic approximation to the input function. 
Similar results for higher order approximations can be developed in a manner similar to that used 
for piecewise constant approximation. 
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projections onto W),,, we use as weights {d,}. We repeat this process until we have 
calculated the projections onto all of the subspaces V; and W,, for 1 < 7 < m. Here m 
is the index such that the scaling function 2-™/*¢ (2x) has width of support equal 
to that of f. The discrete, orthogonal wavelet transform of the function f is given by 


the following collection of projections 


W (f) = {(f, Gyn) [ES F< mM}UL{(F, Ome)}- 


The following is a pseudocode version of what we have just described. 


J=0 





j=l 








j=3 (Ginest scaling level) 


weighted sum of 
fine i 

functions produces 
coarse wavelet or 


scaling function 


support of scaling functions at finest scaling level 





support of f(x) 


Figure 3. Organization of Basis Function 








input: 


1. n+ 1 dilation equation coefficients for the wavelet we wish to use 


2. sequence of NV values which represent the projection of f onto ¢, at the 
finest scaling level. N = n2?~!+ 1 for some p. 


begin algorithm: 

for 7=!l1—m-1:0 

for k=0:n2)-!— 3 

im ev2 7 G28 on) 
Cf pir) = V2 Dimon Coe (fs 6j—14) 
end 


end 
output: W (f) = {(f, en) [ES 7 < O}ULCS, Sox) F 


This brings up another aspect of implementing the wavelet transform on a 
computer. The sequence of subspaces we project onto is bi-infinite. We saw earlier 
that we could pick a starting index based on the resolution with which f was rep- 
resented. The algorithm to compute the transform must stop at some index. What 
should this index be, and what are the consequences of stopping the algorithm here? 
In this development we will stop the transform at the index where the scaling function 
has support width equal to the width of the input function sample. At each step of the 
transform we are calculating the projections of f onto succeedingly lower frequency 
basis functions as the support width of yj, increases. Terminating the algorithm at 
any given index establishes a low frequency bound below which we have no frequency 
localization. 

This section has presented a very basic outline of the discrete, orthogonal 
wavelet transform algorithm. There are many choices as to the indices on which the 
algorithm should begin and terminate. The major concept of the algorithm is the use 
of the relationships II.15 and III.16 to rapidly compute projections at one level from 
those at a preceding level. It is precisely these relationships which allow the wavelet 


transform to be computed in order N operations as we shall now see. 
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To start our study of the computational efficiency of the algorithm we will 
assume the input function is given as N sampled values. We further assume that 
N = 2?n+1 for some p where n is the highest index of {c,}. We divide the algorithm 
into the following blocks. 


1. Calculation of projections at finest scaling level: Nearly any quadrature rule 
can be used to calculate these projections in O (NV) operations. 


2. Calculation of wavelet coefficients: At each level 7 of the p levels of the algo- 
rithm we must calculate n2/ — 2 wavelet coefficients. each of these coefficients 
is calculated by taking a weighted sum of projections onto the scaling coeffi- 
cients at the preceding level. The computational cost for the weighted sum is 
n-+ 1 multiplies and n additions. this makes the total cost for this block 


S (nv ~ 2)(2n4+ 1). 


3. Calculation of scaling function coefficients : At each level we must calculate 
the projections of the function onto the scaling functions. This is accomplished 
by taking a weighted sum of projections onto the scaling functions at the 
preceding level. The computational cost is identical to that for calculating the 
wavelet coefficients above. 


If we sum the computational cost for each of these blocks we get a total 
algorithmic cost of 


O(N) + 2S (no — 2)(2n +1). 


j=0 
The above sum is dominated by 2 (2n + 1) 2? which is O(N). So, we have developed 
a transform which provides good time-frequency localization, can be used as an ap- 
proximation scheme, and is rapidly computed. Some applications and directions for 


further studies are discussed in the next chapter. 
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IV. CONCLUSIONS AND DIRECTIONS 
FOR FURTHER STUDY 


We have shown that we can develop a transform based on solutions to the 
dilation equation. This transform is useful because we can alter the characteristics 
of this transform simply by changing the dilation equation coefficients. Also, we 
can compute this transform quickly. In fact, the order N operations required for 
the wavelet transform is considerably better than the N log (N) operations required 
for the fast Fourier Transform for large N. The wavelet transform has the added 
advantage of time localization. A major advantage of the Fourier Transform is that 
the basis functions are eigenfunctions for an operator of fundamental importance, 
namely the Laplacian operator. The wavelet transform, on the other hand, has been 
restricted predominantly to use in the signal processing field. In this field the wavelets 
time-frequency localization and rapid computation are great assets, and projection 
onto a basis of eigenfunctions is not always as desirable as these other properties. 

To be as useful as the Fourier Transform, wavelets must be “well behaved” 
under some operator of interest. By well behaved we mean the image of the wavelet 
under the operator is simply related to the wavelet or its translations and dilations. 
Figenfunctions for an operator are the ultimate in well behaved functions. It is 
clear from our preliminary work in Chapter II that convolution and convolution type 
operations are the natural operations for wavelets. If we are to find an operator 
under which wavelets would be well behaved, it is natural to first consider operators 
based on convolution like processes. A broad field of such operators is the Zygmund- 
Calderon group of operators. A description of these operators is beyond the scope of 
this work, but this is a burgeoning area for wavelet analysis. 

An area which has great potential is that of tailoring a wavelet to be well 
behaved under a particular operator. To see how we might tailor a wavelet we should 


consider that if we wish our wavelet to have support of width n at the zeroth scaling 
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level, {c,} must have n+1 elements, namely c,... , Cn. We still desire the wavelets to 
be orthogonal, so we must meet the necessary conditions of section 1.3. Specifically, 
yop CkCk—2m = 25m form € Z. Each of these conditions can be represented as a simple 


bi-linear form 
CDs 6 = 20. 


where * indicates conjugate transposition and Dam is the 2m down shift matrix. That 
is, Dam has ones on its 2m" diagonal and zeros elsewhere. If these conditions were 
linear then we could easily determine the solution space for this system. However, 
these conditions are not linear and systems of bi-linear forms are not well studied. 
We can see for m = 0 the condition is >, |c,|" = 2. We can also see for each positive 
value of m the condition is equivalent to the corresponding condition for —m, since 
c*Danc = 0 = O* = c* D3, (c*)* = c*D_amc. So, we have reduced the number of 
conditions from n to aa To make further progress we need to be able to determine 
the solution space of a system of bi-linear forms. The use of the term space here refers 
to the set of all solutions, not necessarily a linear space. The solutions of a system of 
bi-linear forms need not be linear. Once we have the solutions to this system we would 
then determine which of these solutions could be written as linear combinations of the 
vectors {|vp|} as defined in section 1.2 where p is our desired approximation power. 
This would satisfy the sufficient condition for approximation power. Now we check 
these solutions against the sufficient condition for orthogonality presented in section 
1.3. The result would be a collection of dilation equation coefficients which would 
yield orthogonal wavelets with the desired approximation power. Perhaps among this 
collection we would find dilation equation coefficients which would be well behaved 


under the operator of interest. 
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APPENDIX A. DERIVATION OF POISSON 
SUMMATION FORMULA 


We start with the Poisson Summation Formula as found in any text on Fourier 


Analysis 


dof (n) =>) F(2kr), 


neEZ keZ 


where F (€) is the Fourier Transform of f (x). Consider the function 


fw) = (ae), o(e-)ye™. 


We see the Fourier Transform, in the variable |, of f is given by 


Fe) = | ~ (b(2) 6 (a —1)) cea, 


—OO 


Expanding the inner product and simplifying the exponential we get 


(6) = [- - w (x) b (2 — Ddax eH) di. 


Now, change the order of integration, and we see 


Pi@.2) = =[ 4 af ¢ (a —1) e M+8) dl de. 


Make the change of variables y = x — 1, and we now have 
Po ae = / 7 (x) eT) / ~ o (y) et) dy daz. 
We can write the integral in y above as 
[FG ete ay = BCFH. 
This leaves us with 


F(w,8)= [ * op (a) eB (4 Oder 
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since ® (w + €) has no x dependence, we can write this as 
F(w,)= fd weeds OTH, 
The integral in x above is simply the W (w + €) which leads us to 
F(w,€)=Vw+E owt. 
Now, applying the Poisson Summation Formula we get 


Sw (x) ,¢(2—-l))e™ = Sou (w+ 2kr) ® (w+ 2kn), 


LEZ keZ 


which is the desired representation of the Poisson Summation Formula. 


44 





APPENDIX B. PROJECTIONS AT FINEST 
SCALING LEVEL 


To see how we might accomplish this, consider the following diagram. 
f(x) a 


eet aligned with constant f(x) 
a a 


! \ requires special treatment 
—tOUMV—-—_ aligned with constant f(x) 


J 
support width of scaling functions at finest scaling level 


Figure 4. Scaling Functions at Finest Scaling Level 


Fach projection at the finest scaling level is the projection of ¢,, onto either 
a constant or piecewise constant function. Where f is constant over the support of 
gu the projection is simply a weighted integral of ¢,,. Where f is piecewise constant 
over the support of ¢, we can divide the domain of integration so that the projection 
is given by a sum of integrals over domains where f is constant. Each of these sub- 
integrals is given by a weighted integral of ¢,, over a portion of its support. For 
instance, if we are computing the projection of f onto the second scaling function in 


Figure 4, we would have the following 


[ serdayac=of da(oyde+af dn(e)dert [ da(e)de 


Similarly, the projection onto the third scaling function would be 


[Fee tedr=a fds oyde+0 [os(ayae + [os (a) ae 
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The sub-integrals, ee o3 (x) dx, can be computed once and stored for use since they 
depend only on the wavelet used. We will assume the projection of the input function 
onto W/ is zero. ‘This prevents us from incorporating into the transform the disconti- 
nuities introduced by the piecewise constant approximation of f. It is worth noting 
that at this point in the algorithm we have all the information we ever will about the 
input function. In fact, we do not use the function for the rest of the algorithm. The 
remainder of the algorithm is devoted to rearranging the projections of f onto the 


scaling functions at the finest level into projections of f onto the spaces W;, for 7 > 1. 


46 








INITIAL DISTRIBUTION LIST 


1. Defense Technical Information Center 
Cameron Station 
Alexandria, VA 22304-6145 


2. Library, Code 52 
Naval Postgraduate School 
Monterey, CA 93943-5101 


3. Professor Carlos F. Borges, MA/Bc 
Department of Mathematics 
Naval Postgraduate School 
Monterey, CA 93943-5000 


4. Professor Richard Franke, MA/Fe 
Department of Mathematics 
Naval Postgraduate School 
Monterey, CA 93943-5000 


5. Professor Van Emden Henson, MA/Hv 
Department of Mathematics 
Naval Postgraduate School 
Monterey, CA 93943-5000 


6. LT James K. Logue 
Submarine Officer’s Advanced Course 
Submarine School New London 
Groton, CT 06340 


7. Dr. Lou Cleveland 
Department of Mathematics 
3094 Indian Circle 
Marianna, FL 32446 


8. Professor Jack Rogers 
Department of Mathematics 
228 Parker Hall 
Auburn University 
Auburn, AL 36849 








9. Professor William Transue 1 
Department of Mathematics 
228 Parker Hall 
Auburn University 


Auburn, AL 36849 


4S 





